Speech recognizing apparatus with noise model adapting processing unit, speech recognizing method and computer-readable medium

ABSTRACT

A recognizing target vocabulary comparing unit calculates a compared likelihood of recognizing target vocabulary, i.e., a compared likelihood of registered vocabulary, by using the time series of the amount of characteristics of an input speech. An environment adapted noise model comparing unit compares the time series of the amount of characteristics with one recognizing standard pattern or with two or more combined recognizing standard patterns one-by-one to obtain a likelihood that respective environment adaptive noise models coincide with the time series of the amount of characteristics. A rejection determining unit determines whether or not the input signal is noise by comparing the likelihood obtained by the recognizing target vocabulary comparing step with the likelihood obtained by the environment adaptive noise model comparing step. A noise model adapting unit calculates a first likelihood by comparing the time series of the amount of characteristics with recognizing standard patterns and orders the recognizing standard patterns in accordance with the size of the first likelihood. Thus, the environment adaptive noise model matches to a real environment and the rejection determination can be performed for a noise input with high accuracy.

This application is a Continuation of application Ser. No. 10/329,553,filed Dec. 27, 2002 and claims the benefit of priority from the priorJapanese Application No. 2001 401615, filed Dec. 28, 2001. The entirecontents of these applications are incorporated herein by reference.

BACKGROUND OF INVENTION

1. Field of the Invention

The present invention relates to a speech recognizing apparatus, aspeech recognizing method, and a speech recognizing program which arepreferable to reject environmental noises other than a recognizingtarget vocabulary.

2. Description of the Related Art

Recently, the improvement in performance of a speech recognizingtechnology causes the widely practical use of speech recognizing engineunder a real environment. In particular, the case of limiting inputdevices in a car navigation system or a mobile device and the likeincreasingly requires the speech recognition. Under the above mentionedenvironment, a hand free function is raised as one of the functionsstrongly desired for the speech recognition, in order to continuouslycapture the speech and shift to predetermined processing only in theoccasion when a previously registered vocabulary is inputted.

For example, in the car navigation system, various environmental noisessuch as noises generated by running, klaxon, and noises generated byanother-vehicle running are inputted to the speech recognizing engineduring continuously capturing the speech under the real environment.Thus, the speech recognizing engine requires a function for correctlyrecognizing the user's speech and rejecting non-speech such as thevarious environment noises.

The conventional speech recognizing apparatus compares a recognizingtarget vocabulary formed based on a phoneme model with the amount ofcharacteristics extracted from an input speech, and outputs the highestvalue of the comparison result that respective recognizing targetvocabularies coincide with the time series of the amount ofcharacteristics (hereinafter, referred to as a likelihood) as a resultof recognizing the speech. A likelihood of the input of environmentalnoises becomes relatively low comparing with the likelihood of the inputof recognizing target vocabulary. Therefore, non-speech is rejected bysetting a predetermined threshold. However, when the real environment isdifferent from the environment under which the recognizing targetvocabulary is formed, the likelihood of the inputted recognizing targetvocabulary might become low and even the recognizing target vocabularymight be rejected too.

Then, a method for rejecting the input of a non-registered vocabulary tothe speech recognizing engine is used on a certain occasion, asdisclosed in “Rejection of unknown speech by correcting likelihood usingsyllable recognition” presented in the Institute of Electronics,Information and Communication Engineers (IEICE) transactions D-II, Vol.J75-D-II, No. 12, pages 2002-2009 (hereinafter, referred to as a firstliterature).

According to the method disclosed in the first literature, thelikelihood is calculated by comparing the input speech against therecognizing target vocabulary and also the optimal phoneme series isobtained by using all phoneme models against a previously storedrecognizing-unit, thus obtaining the likelihood. The likelihood as aresult of comparing the input speech against the recognizing targetvocabulary largely varies between the recognizing target vocabulary(registered vocabulary) and the non-registered vocabulary and; on theother hand, the variation of likelihood in the optimal phoneme series issmall. Even when the real environment is different from an environmentunder which the recognizing target vocabulary and the phoneme model asthe previously stored recognizing-unit are formed, the influence inenvironment caused in the input speech appears both in the likelihood ofthe optimal phoneme series and in the likelihood of the recognizingtarget vocabulary. Therefore, a value obtained by subtracting thelikelihood as the result of comparing the input speech against therecognizing target vocabulary from the likelihood of the optimal phonemeseries does not vary irrespective of the difference of the environment.Rejection is accurately performed by detecting the non-registered worddepending on the difference between the likelihoods.

However, while an unknown input speech has no problem, in the case ofinput sound which is not included in the phoneme model such as klaxon,both the likelihood of the optimal phoneme series and the likelihood ofthe recognizing target vocabulary are extremely low. The differencebetween the likelihood of the optimal phoneme series and the likelihoodof the recognizing target vocabulary sometimes happens to be relativelylow. In such case, the rejection is impossible by determining thethreshold.

Further, another method for rejecting the input of the non-registeredvocabulary to the speech recognizing engine is used, as disclosed inJapanese Unexamined Patent Application Publication No. 11-288295(hereinafter, referred to as a second literature). In this proposal,words as the recognizing target vocabulary are previously stored andeven words which are erroneously recognized as noises are stored as therecognizing target vocabulary including the environmental noise.

According to the method disclosed in the second literature, when a wordhaving the maximum compared likelihood is included in the recognizingtarget vocabularies as a result of comparing the input speech againstthe stored recognizing target vocabulary, the recognizing result isoutputted. On the contrary, when a word having the maximum comparedlikelihood is included in the recognizing target vocabularies containingthe environmental noise, the input speech is determined as a noise andrejected.

However, the above-mentioned proposal of the second literature needs tostore, as the recognizing target vocabulary including the environmentnoise, the words which are erroneously recognized as the noise in manycases. When the environment of the speech recognition is unspecified,the words which tend to be erroneously recognized as the noises in manycases cannot substantially be provided under any noise environment.

The above-mentioned speech recognizing apparatuses according to thefirst and second literatures have a problem in that the rejectingperformance is not obtained for the input of only the environmentalnoise including no speech.

SUMMARY OF THE INVENTION

Accordingly, it is an object of the present invention to provide aspeech recognizing apparatus, a speech recognizing method, and a speechrecognizing program for preventing the erroneous operation with highaccuracy, irrespective of the noise environment.

According to the present invention, a speech recognizing apparatuscomprises: a speech section detecting unit to detect a speech sectionfrom an input signal; a characteristic amount extracting unit to analyzeinput speech, which is the input signal in said speech section, andextracting a time series of the amount of characteristics representingcharacteristics of the input speech; a recognizing target vocabularystoring unit to store predetermined recognizing target vocabularies; arecognizing target vocabulary comparing unit to compare the time seriesof the amount of characteristics with respective recognizing targetvocabularies read from the recognizing target vocabulary storing unitone by one to obtain a likelihood that respective recognizing targetvocabularies coincide with the time series of the amount ofcharacteristics; an environment adaptive noise model storing unit tostore an environment adaptive noise models adapted to an environmentalnoise; an environment adaptive noise model comparing unit to compare thetime series of the amount of characteristics with respective environmentadaptive noise models read from the environment adaptive noise modelstoring unit one by one to obtain a likelihood that respectiveenvironment adaptive noise models coincide with the time series of theamount of characteristics; a rejection determining unit to determinewhether or not the input signal is a noise by comparing the likelihoodof the registered vocabulary obtained by said recognizing targetvocabulary comparing unit with the likelihood of the environmental noiseobtained by said environment adaptive noise model comparing unit; and anoise model adapting unit to update the environment adaptive noise modelso as to adapt to the input signal when said rejection determining unitdetermines that the input signal is the noise.

Further, according to the present invention, a speech recognizingapparatus comprises: a speech section detecting unit to detect a speechsection from an input signal; a characteristic amount extracting unit toanalyze an input speech, which is the input signal in said speechsection, and extracting the time series of the amount of characteristicsrepresenting the characteristics of the input speech; a recognizingtarget vocabulary storing unit to store predetermined recognizing targetvocabularies; a recognizing target vocabulary comparing unit to comparethe time series of the amount of characteristics with respectiverecognizing target vocabularies read from the recognizing targetvocabulary storing unit one by one to obtain a likelihood thatrespective recognizing target vocabularies coincide with the time seriesof the amount of characteristics; a recognizing-unit standard patternstoring unit to store recognizing-unit standard patterns; an environmentadaptive recognizing-unit selecting unit to select at least onerecognizing-unit standard patterns adaptive to an environmental noise,stored in said recognizing-unit standard pattern storing unit; anenvironment adaptive noise model comparing unit to compare the timeseries of the amount of characteristics with one recognizing-unitstandard pattern or with two or more combined recognizing-unit standardpatterns, selected by said environment adaptive recognizing-unitselecting unit one by one, to obtain a likelihood that said respectiveenvironment adaptive noise models coincide with the time series ofcharacteristics; and a rejection determining unit to determine whetheror not the input signal is a noise based on the likelihood obtained bysaid recognizing target vocabulary comparing unit and the likelihoodobtained by said environment adaptive noise model comparing unit,wherein said environment adaptive recognizing-unit selecting unitselects again the recognizing-unit standard pattern stored in saidrecognizing-unit standard pattern storing unit so as to adapt to theinput signal when said rejection determining unit determines that theinput signal is the noise.

Furthermore, according to the present invention, a speech recognizingmethod comprises: a speech section detecting step of detecting a speechsection from an input signal; a characteristic amount extracting step ofanalyzing an input speech, which is the input signal in said speechsection, and extracting the time series of the amount of characteristicsrepresenting characteristics of the input speech; a recognizing targetvocabulary comparing step of comparing the time series of the amount ofcharacteristics with respective recognizing target vocabularies readfrom a recognizing target vocabulary storing unit to store predeterminedrecognizing target vocabularies one by one to obtain a likelihood thatrespective recognizing target vocabularies coincide with the time seriesof the amount of characteristics; an environment adaptive noise modelcomparing step of comparing the time series of the amount ofcharacteristics with respective environment adaptive noise models readfrom the environment adaptive noise model storing unit to storepredetermined environment adaptive noise models one by one to obtain alikelihood that respective environment adaptive noise models coincidewith the time series of the amount of characteristics; a rejectiondetermining step of determining whether or not the input signal is anoise by comparing the likelihood obtained by said recognizing targetvocabulary comparing step with the likelihood obtained by environmentadaptive noise model comparing step; and a noise model adapting step ofupdating the environment adaptive noise model so as to adapt to theinput signal when it is determined that the input signal is the noise.

In addition, according to the present invention, a speech recognizingmethod comprises: a speech section detecting step of detecting a speechsection from an input signal; a characteristic amount extracting step ofanalyzing an input speech, which is the input signal in said speechsection, and extracting the time series of the amount of characteristicsof the input speech; a recognizing target vocabulary comparing step ofcomparing the time series of the amount of characteristics withrespective recognizing target vocabularies read from a recognizingtarget vocabulary storing unit to store predetermined recognizing targetvocabularies one by one to obtain a likelihood that respectiverecognizing target vocabularies coincide with the time series of theamount of characteristics; an environment adaptive recognizing-unitselecting step of selecting at least one recognizing-unit standardpatterns adaptive to an environmental noise from a recognizing-unitstandard pattern storing unit to store recognizing-unit standardpatterns; an environment adaptive noise model comparing step forcomparing the time series of the amount of characteristics with onerecognizing-unit standard pattern or with two or more combinedrecognizing-unit standard patterns, selected by said environmentadaptive recognizing-unit selecting step one by one, to obtain alikelihood that said respective environment adaptive noise modelscoincide with the time series of characteristics; a rejectiondetermining step of determining whether or not the input signal is anoise based on the likelihood obtained by the environment adaptiverecognizing-unit selecting step and the likelihood obtained by theenvironment adaptive noise model comparing step; and a step of selectingagain the recognizing-unit standard pattern stored in saidrecognizing-unit standard pattern storing unit so as to adapt to theinput signal when it is determined that the input signal is the noise.

In addition, according to the present invention, a speech recognizingprogram product allows a computer to execute: speech section detectingprocessing for detecting a speech section from an input signal;characteristic amount extracting processing for analyzing an inputspeech, which is the input signal in said speech section, and extractingthe time series of the amount of characteristics representingcharacteristics of the input speech; a recognizing target vocabularycomparing processing of comparing the time series of the amount ofcharacteristics with respective recognizing target vocabularies readfrom a recognizing target vocabulary storing unit to store predeterminedrecognizing target vocabularies one by one to obtain a likelihood thatrespective recognizing target vocabularies coincide with the time seriesof the amount of characteristics; an environment adaptive noise modelcomparing processing of comparing the time series of the amount ofcharacteristics with respective environment adaptive noise models readfrom the environment adaptive noise model storing unit to storepredetermined environment adaptive noise models one by one to obtain alikelihood that respective environment adaptive noise models coincidewith the time series of the amount of characteristics; rejectiondetermining processing for determining whether or not the input signalis a noise by comparing the likelihood obtained by recognizing targetvocabulary comparing processing with the likelihood obtained byenvironment adaptive noise model comparing processing; and noise modeladapting processing for updating the environment adaptive noise model soas to adapt to the input signal when it is determined that the inputsignal is the noise.

In addition, according to the present invention, a speech recognizingprogram product allows a computer to execute: speech section detectingprocessing for detecting a speech section from an input signal;characteristic amount extracting processing for analyzing an inputspeech, which is the input signal in said speech section, and extractingthe time series of the amount of characteristics representing thecharacteristics of the input speech; a recognizing target vocabularycomparing processing of comparing the time series of the amount ofcharacteristics with respective recognizing target vocabularies readfrom a recognizing target vocabulary storing unit to store predeterminedrecognizing target vocabularies one by one to obtain a likelihood thatrespective recognizing target vocabularies coincide with the time seriesof the amount of characteristics; an environment adaptiverecognizing-unit selecting processing of selecting at least onerecognizing-unit standard patterns adaptive to an environmental noisefrom a recognizing-unit standard pattern storing unit to storerecognizing-unit standard patterns; an environment adaptive noise modelcomparing processing for comparing the time series of the amount ofcharacteristics with one recognizing-unit standard pattern or with twoor more combined recognizing-unit standard patterns, selected by saidenvironment adaptive recognizing-unit selecting step one by one, toobtain a likelihood that said respective environment adaptive noisemodels coincide with the time series of characteristics; rejectiondetermining processing for determining whether or not the input signalis a noise based on the likelihood obtained by recognizing targetvocabulary comparing processing and the likelihood obtained byenvironment adaptive noise model comparing processing; and processingfor selecting again the recognizing-unit standard pattern stored in saidrecognizing-unit standard pattern storing unit so as to adapt to theinput signal when it is determined that the input signal is the noise.

The above and other objects, features, and advantages of the inventionwill become more clearly understood from the following descriptionreferring to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing the structure of a speech recognizingapparatus according to a first embodiment of the present invention;

FIG. 2 is an explanatory diagram of the operation of the speechrecognizing apparatus according to the first embodiment;

FIG. 3 is a block diagram showing the structure of a speech recognizingapparatus according to a second embodiment of the present invention;

FIG. 4 is a block diagram showing the structure of a speech recognizingapparatus according to a third embodiment of the present invention;

FIG. 5 is an explanatory diagram of the concept of word spotting;

FIG. 6 is an explanatory diagram of the concept forcorrecting/normalizing compared likelihoods;

FIG. 7 is a flowchart for explaining the operation of the speechrecognizing apparatus according to the third embodiment;

FIGS. 8A and 8B are explanatory diagrams of the operation of the speechrecognizing apparatus according to the third embodiment;

FIG. 9 is an explanatory diagram of statuses for selecting noise models(adaptive to the environment) upon determining the noise; and

FIG. 10 is an explanatory diagram of the advantages of the speechrecognizing apparatus according to the third embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinbelow, embodiments of the present invention will be described indetail with reference to the drawings. FIG. 1 is a block diagramschematically showing the structure of a speech recognizing apparatusaccording to a first embodiment of the present invention.

According to the first embodiment, words as recognizing targets arestored as recognizing target vocabularies and a noise model adaptive tothe environment (hereinafter, referred to as an environment adaptivenoise model) is simultaneously stored. The rejecting performanceconsidering environment noises under the entire real environment isobtained by adaptively updating the environment adaptive noise modelbased on the result of determining the rejection.

Referring to FIG. 1, a speech section detecting unit 101 analyzes aninput signal, detects a speech section, and outputs a signal in thedetected speech section to a characteristic amount extracting unit 102.The characteristic amount extracting unit 102 acoustically analyzes theinput signal in the speech section, thereby extracting a time series ofthe amount of characteristics.

For example, the characteristic amount extracting unit 102 performsfrequency analysis of the input speech with respect to a plurality offrequency bands which are predetermined to obtain a result of analyzingthe frequency bands as characteristic vectors (characteristicparameters). The characteristic vectors (characteristic parameters) areobtained for every fixed-time length called a frame as a unit and thecharacteristic amount extracting unit 102 obtains a characteristicvector series (time series of the characteristic vectors) in the speechsection. The time series of the amount of characteristics extracted bythe characteristic amount extracting unit 102 is supplied to arecognizing target vocabulary comparing unit 104 and an environmentadaptive noise model comparing unit 106.

Typical well-known characteristic vectors used for the speechrecognition are power spectrum obtained by a band pass filter or Fouriertransform, cepstrum counting obtained by LPC (Linear Predictive Coding)analysis, and the like. According to the first embodiment, any type ofthe user characteristic vector may be used.

A recognizing target storing unit 103 stores the recognizing targetvocabulary as recognizing target words. The recognizing targetvocabulary is formed based on the phoneme model. The recognizing targetvocabulary comparing unit 104 reads the recognizing target vocabularyfrom the recognizing target vocabulary storing unit 103, compares theread recognizing target vocabulary against the time series of the amountof characteristics obtained for every recognizing target vocabulary bythe characteristic amount extracting unit 102, and obtains thelikelihood (hereinafter, referred to as a likelihood of the registeredvocabulary). The recognizing target vocabulary comparing unit 104outputs the obtained and registered vocabulary likelihood to a rejectiondetermining unit 107.

As methods for calculating the compared likelihood, there are methodbased on DP matching or HMM (Hidden Marcov Model) described in detail inthe book titled “Speech recognition using probabilistic model” writtenby Seiichi NAKAGAWA and published by the IEICE (The Institute ofElectronics, Information and Communication Engineers) (hereinafter,referred to as a third literature).

The environment adaptive noise model storing unit 105 previously storesthe noise model adaptive to the environment (environment adaptive noisemodel). Various environment noise models are considered. For example, aset of words (vocabularies) may be used as the environment noise model,the above-mentioned HMM according to the third literary may be used, aGaussian distribution expressed by an average μ and a distribution σ,GMM (Generalized Moment Method) may be used, or a discrete model may beused.

An environment adaptive noise model comparing unit 106 compares theenvironment adaptive noise model read from the environment adaptivenoise model storing unit 105 against the time series of the amount ofcharacteristics obtained by the characteristic amount extracting unit102 to obtain the likelihood (hereinafter, referred to as the likelihoodof the environmental noise). The environment adaptive noise modelcomparing unit 106 outputs the obtained likelihood of the environmentalnoise to the rejection determining unit 107.

The rejection determining unit 107 compares the likelihood of theregistered vocabulary from the recognizing target vocabulary comparingunit 104 with the likelihood of the environmental noise from theenvironment adaptive noise model comparing unit 106, thereby determiningthe rejection of the input speech. For example, the rejectiondetermining unit 107 compares the likelihood of the registeredvocabulary with the likelihood of the environmental noise. If thelikelihood of the registered vocabulary is larger than the likelihood ofthe environmental noise, the rejection determining unit 107 outputs theselected likelihood of the recognizing target vocabulary as the resultof recognizing the speech. If the likelihood of the environment noise islarger than the likelihood of the recognizing target vocabulary, theinput speech is determined as the noise and is rejected.

According to the first embodiment, the rejection determining unit 107outputs the determination result to a noise model adapting unit 108. Ifthe input speech is determined as the noise, the noise model adaptingunit 108 updates the environment adaptive noise model stored in theenvironment adaptive noise model storing unit 105 so as to adapt to theinput.

For example, the rejection determining unit 107 matches the environmentnoise model stored in the environment adaptive noise model storing unit105 to the time series of the amount of characteristics of the inputspeech (the time series of the characteristic vector).

Next, a description is given regarding the operation of the speechrecognizing apparatus according to the first embodiment with referenceto FIG. 2. FIG. 2 shows an example of the environment adaptive noisemodel expressed by the Gaussian distribution.

The signal in the speech section which is detected by the speech sectiondetecting unit 101 is supplied to the characteristic amount extractingunit 102, and is analyzed by a plurality of predetermined frequencybands. Consequently, the characteristic amount extracting unit 102converts the input speech into the series of a characteristic vector(time series of the characteristic vector), and supplies it to therecognizing target vocabulary comparing unit 104 and the environmentadaptive noise model 106.

The recognizing target vocabulary comparing unit 104 compares the inputspeech against the time series of characteristic vector which isinputted for every recognizing target vocabulary stored in therecognizing target vocabulary storing unit 103, and calculates thelikelihood of the registered vocabulary.

The environment adaptive noise model comparing unit 106 reads theenvironment adaptive noise model stored in the environment adaptivenoise model storing unit 105, and calculates the likelihood of theenvironment noise between the environment adaptive noise model and theinputted time series of the characteristic vector.

The compared likelihood calculated by the recognizing target vocabularycomparing unit 104 and the environment adaptive noise model comparingunit 106 is supplied to the rejection determining unit 107. Therejection determining unit 107 compares the likelihood of the registeredvocabulary with the likelihood of the environmental noise, therebydetermining the rejection.

For example, in the method using the HMM according to the thirdliterature, reference symbol Si denotes a likelihood of the registeredvocabulary of a recognizing target vocabulary i, and reference symbolSns denotes a likelihood of the environmental noise using theenvironment adaptive noise model. The recognizing target vocabulary isselected to obtain a maximum value max (Si) (maximum likelihood of theregistered vocabulary) among the likelihoods of the registeredvocabulary Si. If the likelihood of the registered vocabulary Si of theselected recognizing target vocabulary is larger than the likelihood ofthe environment noise Sns, it is determined that input speech is not thenoise and the selected recognizing target vocabulary is outputted as aresult of the recognized speech.

On the contrary, if the likelihood of the environment noise Sns islarger than the maximum likelihood of the registered vocabulary Si, therejection determining unit 107 determines that the input speech is thenoise and rejects the input speech.

According to the first embodiment, the determination result of therejection determining unit 107 is supplied to the noise model adaptingunit 108. The noise model adapting unit 108 updates the environmentnoise model so as to adapt to the environmental noise.

It is assumed that the environment adaptive noise model is expressed bythe Gaussian distribution shown in FIG. 2 (having the average μ and thedistribution σ). A thin line in FIG. 2 indicates the distribution of theenvironment adaptive noise model, and a thick line in FIG. 2 indicatesthe distribution of the input speech. To the environment adaptive noisemodel shown by the thin line in FIG. 2, the speech shown by the thickline is inputted and then the rejection determining unit 107 determinesthat the input speech is the noise. Referring to FIG. 2, in the case ofthe input speech having the distribution in a shadow portion, thelikelihood of the environmental noise Sns has a small value. Althoughthe input speech in this case should be rejected, the rejectiondetermining unit 107 actually does not reject the input speech.

According to the first embodiment, however, the noise model adaptingunit 108 adaptively changes the environment adaptive noise model. Forexample, the noise model adapting unit 108 matches the environmentadaptive noise model to the input speech. That is, the noise modeladapting unit 108 calculates the average and the distribution of thetime series of the amount of characteristics, regarding the input speechwhich is determined as the noise by the rejection determining unit 107,and replaces, with the calculated values, the values of the average andthe distribution of the environment adaptive noise model stored in theenvironment adaptive noise model storing unit 105. In other words, thedistribution shown by the thin line in FIG. 2 matches to thedistribution shown by the thick line.

Then, the rejection determining unit 107 subsequently rejects the inputspeech having the distribution in the shadow portion included in theportion shown by the thick line in FIG. 2.

As mentioned above, according to the first embodiment, the predeterminednoise model is adaptively updated based on the determining result andthe determination of the rejection is possible by using the noise modelmatching to the real environment. If it is determined that the inputspeech is the noise, the noise model is made adaptive to theenvironment, thereby rejecting the input noise with high accuracy evenunder unspecified environments different from the environment of thepreviously learned noise model. Accordingly, the erroneous operation dueto the noise can be prevented with high accuracy irrespective of thenoise environment.

The environment adaptive noise model and the method for adapting theenvironment are not limited to those according to the first embodiment.

FIG. 3 is a block diagram schematically showing the structure of aspeech recognizing apparatus according to a second embodiment. Referringto FIG. 3, the same components in FIG. 1 are designated by the samereference numerals and a description thereof is omitted.

According to the first embodiment, the noise model adapting unit 108updates the previously-stored noise model in accordance with the inputnoise, thereby adapting the noise model to the environmental noise.However, according to the second embodiment, the recognizing-unitstandard pattern is previously stored and a pattern matching to theenvironmental noise is selected from the recognizing-unit standardpatterns, thereby realizing the adaptation to the environment.

According to the second embodiment, unlike the first embodiment, arecognizing-unit standard pattern storing unit 205 and an environmentadaptive noise model selecting unit 208 are provided, in place of theenvironment adaptive noise model storing unit 105 and the noise modeladapting unit 108 in FIG. 1.

The recognizing-unit standard pattern storing unit 205 previouslyregisters standard recognizing-unit patterns as a set of phoneme models.The HMM according to the third literature is used as a model whichexpresses the recognizing-unit standard pattern.

If the rejection determining unit 107 determines that the input speechis the noise, the environment adaptive noise model selecting unit 208changes the selected standard pattern which is read from therecognizing-unit standard pattern storing unit 205 and supplies thechanged standard pattern to the environment adaptive noise modelcomparing unit 106.

For example, if the rejection determining unit 107 determines that theinput speech is the noise, the environment adaptive noise modelselecting unit 208 calculates the likelihood by comparing the timeseries of the amount of characteristics obtained by the characteristicamount extracting unit 102 against the recognizing-unit standard patternstored in the recognizing-unit standard pattern storing unit 205, ordersthe recognizing-unit standard patterns in accordance with the size ofthe likelihood, and selects only the predetermined number ofhigh-ordered recognizing-unit standard patterns.

The environment adaptive noise model comparing unit 106 combines aplurality of the recognizing-unit standard patterns selected by theenvironment adaptive noise model selecting unit 208 and calculates thelikelihood of the environment noise for the new input.

Next, the operation with the above-mentioned structure will be describedaccording to the second embodiment.

Now, the rejection determining unit 107 determines that the input speechis the noise. This determination result is supplied to the environmentadaptive noise model selecting unit 208. The environment adaptive noisemodel selecting unit 208 changes the standard pattern selected from therecognizing unit standard pattern storing unit 207.

For example, the environment adaptive noise model selecting unit 208compares the time series of the amount of characteristics of the inputspeech against the recognizing-unit standard pattern stored in therecognizing-unit standard pattern storing unit 205, thereby calculatingthe likelihood. Further, the environment adaptive noise model selectingunit 208 orders the recognizing-unit standard patterns in accordancewith the size of the likelihood, and selects only the predeterminednumber of high-ordered recognizing unit standard patterns. Thus, theenvironment adaptive noise model changes to the pattern similar to thetime series of the amount of characteristics of the input speech.

Then, the environment adaptive noise model matches to the realenvironment. The environment adaptive noise model comparing unit 106combines a plurality of selected recognizing-unit standard patterns, andcalculates the likelihood of the environmental noise. Thus, therejection determining unit 107 can reject the input noise with highaccuracy.

According to the second embodiment, the environment adaptive noise modelis formed by selecting the predetermined number of recognizing-unitstandard patterns. In the case of determining the rejection, theselection of the recognizing-unit standard pattern is adaptivelychanged, thereby obtaining the environment adaptive noise model matchingto the real environment. Thus, the erroneous operation due to the noisescan be prevented with high accuracy irrespective of the noiseenvironment.

According to the second embodiment, unlike the first embodiment, therecognizing-unit standard pattern is formed based on the phoneme modelwithout forming a new noise model. Further, according to the secondembodiment, the noise model is formed by selecting a part of therecognizing-unit standard patterns based on the phoneme model.Advantageously, the rejection can accurately be determined withoutpreventing the likelihood of the environmental noise which is higherthan the likelihood of the registered vocabulary irrespective of theinput speech.

FIG. 4 is a block diagram schematically showing the structure of aspeech recognizing apparatus according to a third embodiment of thepresent invention. Referring to FIG. 4, the same components in FIG. 3are designated by the same reference numerals and a description thereofis omitted.

According to the third embodiment, the rejection is determined withfurther high accuracy by using not only the likelihood of the registeredvocabulary and the likelihood of the environment noise but also thelikelihood obtained by comparing against the optimal phoneme series(hereinafter, referred to as a best likelihood).

According to the third embodiment, the time series of the characteristicvector extracted from the signal in the speech section by thecharacteristic amount extracting unit 102 is supplied not only to arecognizing vocabulary comparing unit 303 and an environment adaptivenoise model comparing unit 305 but also to a optimal phoneme seriescomparing unit 304.

The recognizing-unit standard pattern storing unit 205 stores therecognizing-unit standard patterns as a set of the phoneme models. Therecognizing-unit standard pattern stored in the recognizing-unitstandard pattern storing unit 205 typically uses the HMM (Hidden MarcovModel) which is previously learned for every biphoneme, diphoneme, ortriphoneme or the like. According to the third embodiment, any type ofthe used recognizing unit and recognizing-unit standard pattern may beused. The recognizing target vocabulary storing unit 103 stores therecognizing target vocabulary as the recognizing target.

The optimal phoneme series comparing unit 304 combines therecognizing-unit standard patterns stored in the recognizing-unitstandard pattern storing unit 205 without the limitation of thevocabulary, obtains the comparing likelihood against the time series ofcharacteristic vector inputted from the characteristic amount extractingunit 102, and outputs a result of combining the recognizing-unitstandard pattern having the maximum likelihood (optimal likelihood) andthe optimal likelihood thereof. An output of the optimal phoneme seriescomparing unit 304 is supplied to a registered vocabulary likelihoodcorrecting/normalizing unit 309, an environment noise likelihoodcorrecting/normalizing unit 311, and an environment adaptive recognizingunit selecting unit 308.

The environment adaptive recognizing-unit selecting unit 308 previouslyselects the recognizing-unit standard pattern which frequently appearsunder the real noise environment, and outputs the selectedrecognizing-unit standard pattern to the environment adaptive noisemodel comparing unit 305. Further, the environment adaptiverecognizing-unit selecting unit 308 adaptively selects the selectedrecognizing-unit standard pattern, based on the output of the optimalphoneme series comparing unit 304, the determination result of arejection determining unit 312 using the compared likelihood, and theoutput by the rejection determining unit 312 using the environmentadaptive noise model.

The recognizing target vocabulary comparing unit 303 combines therecognizing-unit standard patterns stored in the recognizing-unitstandard pattern storing unit 205 for every recognizing targetvocabulary stored in the recognizing target vocabulary storing unit 306,performs word spotting by using a halfway process of the operation forcomparing the optimal phoneme series inputted from the optimal phonemeseries comparing unit 304, and compares the vocabulary against the timeseries of characteristic vector inputted from the characteristic amountextracting unit 102, thereby obtaining the likelihood of the registeredvocabulary. Further, the recognizing target vocabulary comparing unit303 outputs the length of continuous time of the recognizing vocabularyobtained by the likelihood of the registered vocabulary and the wordspotting.

FIG. 5 is an explanatory diagram showing the concept of the wordspotting. In usual conversations, a meaningless phoneme string might beadded to the front or back of the registered vocabulary. In the wordspotting, the registered vocabulary is extracted from the input speech.Referring to FIG. 5, the registered vocabulary is extracted by comparingagainst the optimal phoneme series simultaneously or before/after thetiming for comparing the recognizing target vocabulary. The method forthe word spotting uses the method described in detail in the book titled“Speech recognition using probabilistic model”, written by SeiichiNAKAGAWA, published by the IEICE (The Institute of Electronics,Information and Communication Engineers).

A registered vocabulary likelihood correcting/normalizing unit 309corrects and normalizes the likelihood of the registered vocabulary forevery recognizing target vocabulary transmitted from the recognizingtarget vocabulary comparing unit 303 by using the optimal likelihoodfrom the optimal phoneme series comparing unit 304 and the length ofcontinuous time for each of the recognizing target vocabularies from therecognizing target vocabulary comparing unit 303.

FIG. 6 is an explanatory diagram of the concept forcorrecting/normalizing the compared likelihood.

Referring to FIG. 6, as the recognizing-unit standard pattern, thephoneme expressed by a phonetic symbol is used. The recognizing targetvocabulary comparing unit 303 calculates the likelihood of theregistered vocabulary based on the word spotting by using the halfwaycomparing process provided by the optimal phoneme series comparing unit304. Consequently, a compared score of a best portion matching to therecognizing target vocabulary is obtained from the detected speechsections by calculating the difference between the optimal likelihoodSopt and the likelihood of the registered vocabulary Si.

The normalization using the length of continuous time Ti of the spottedrecognizing target vocabulary enables the calculation of the averagecomparing likelihood per unit time in the segment matching to therecognizing target vocabulary in the speech sections (the likelihood ofthe registered vocabulary after correction/normalizationPi=(Sopt−Si)/Ti).

The smaller the value Pi of the corrected/normalized likelihood is, thecloser the matching result of the recognizing target vocabulary is tothe matching result of the optimal phoneme series comparing unit. Thus,the speech having the smaller value Pi is closer to the recognizingvocabulary.

A recognizing result determining unit 310 compares the average comparedlikelihoods corrected/normalized for every recognizing target vocabularytransmitted from the registered vocabulary likelihoodcorrecting/normalizing unit 309, and determines the recognizing targetvocabulary based on the size of the likelihood. The rejectiondetermining unit 312 using the compared likelihood compares thecorrected/normalized compared likelihood of the recognizing targetvocabulary determined by the recognizing result determining unit 310with the predetermined threshold, and determines based on the comparisonresult whether or not the input speech is the noise. If it is determinedthat the input speech is a speech, the rejection determining unit 312outputs the determined recognizing target vocabulary to the rejectiondetermining unit 313 using the environment adaptive noise model.Further, the determining result from the rejection determining unit 312is supplied to the environment adaptive recognizing-unit selecting unit308. If it is determined that the input speech is a noise, the rejectiondetermining unit 312 outputs the rejecting result.

The environment adaptive noise model comparing unit 305 combines therecognizing-unit standard patterns selected by the environment adaptiverecognizing-unit selecting unit 308, performs the word spotting by usingthe halfway processing of comparing the optimal phoneme series inputtedfrom the optimal phoneme series comparing unit 304, compares the spottedword with the time series of characteristic vector inputted from thecharacteristic amount extracting unit 102 to obtain the likelihood, andoutputs the compared maximum likelihood of environment noise of thecombining results of the recognizing-unit standard patterns and thelength of continuous time.

The environment noise likelihood correcting/normalizing unit 311corrects/normalizes the likelihood of the environment noise from theenvironment adaptive noise model comparing unit 305 by using the optimallikelihood from the optimal phoneme series comparing unit 304 and thelength of continuous time of the environment adaptive noise model fromthe environment adaptive noise model comparing unit 305 based on thesame method as that in FIG. 6. The environment noise likelihoodcorrecting/normalizing unit 311 outputs the likelihood aftercorrection/normalization to the rejection determining unit 313 using theenvironment adaptive noise model.

If the rejection determining unit 312 using the compared likelihooddetermines that the input speech is not the noise, the rejectiondetermining unit 313 using the environment adaptive noise model comparesthe likelihood of the registered vocabulary aftercorrection/normalization with the likelihood of the environment noiseafter correction/normalization, determines whether the input speech isthe recognizing target vocabulary or the noise based on the comparisonresult, and outputs the determination result to the environment adaptiverecognizing unit selecting unit 308. If it is determined that thelikelihood of the registered vocabulary is smaller, the rejectiondetermining unit 313 using the environment adaptive noise model outputsthe determined recognizing target vocabulary as the result ofrecognizing the speech.

If the rejection determining unit 312 using the compared likelihood orthe rejection determining unit 313 using the environment adaptive noisemodel determines that the input speech is the noise, the environmentadaptive recognizing-unit selecting unit 308 receives the determiningresult, updates the appearance frequency of the recognizing-unitstandard pattern selected by the environment adaptive recognizing-unitselecting unit 308 by using the result of combining the recognizing-unitstandard patterns based on the result of comparing the optimal phonemeseries, and selects again the recognizing-unit standard pattern.

Next, a description is given regarding the operation with theabove-mentioned structure according to the third embodiment withreference to FIGS. 7 to 10. FIG. 7 is a flowchart for explaining theoperation until determining the rejection, FIGS. 8A and 8B areexplanatory diagrams of the operation of the rejection determining unitusing the environment adaptive noise model.

Referring to FIG. 7, in step 400, the speech is inputted. Thecharacteristic amount extracting unit 102 converts the signal in thespeech section into a series of characteristic vector (time series ofthe characteristic vector). The time series of the characteristic vectorin the speech section is supplied to the recognizing target vocabularycomparing unit 303, the optimal phoneme series comparing unit 304, andthe environment adaptive noise model comparing unit 305.

Each of the recognizing target vocabulary comparing unit 303, theoptimal phoneme series comparing unit 304, and the environment adaptivenoise model comparing unit 305 compares the time series of thecharacteristic vector with the combined recognizing-unit standardpattern which is previously stored in the recognizing-unit standardpattern storing unit 205 to calculate respective likelihood.

The optimal phoneme series comparing unit 304 combines therecognizing-unit standard patterns stored in the recognizing-unitstandard pattern storing unit 205 without limitation of the vocabulary,calculates the likelihood based on the combined result and the timeseries of the characteristic vector from the characteristic amountextracting unit 102, and outputs the result of combining therecognizing-unit standard patterns having the maximum likelihood and thelikelihood thereof (optimal likelihood). The method for calculating thelikelihood uses the Viterbi algorithm when using the HMM for therecognizing-unit standard pattern.

The recognizing target vocabulary comparing unit 303 combines therecognizing-unit standard patterns stored in the recognizing-unitstandard pattern storing unit 205 based on the recognizing targetvocabulary stored in the recognizing target storing unit 103, performsthe word spotting by using the halfway processing for comparing theoptimal phoneme series inputted from the optimal phoneme seriescomparing unit 304, and calculates the likelihood between the combinedspotted result and the time series of the characteristic vector from thecharacteristic amount extracting unit 102. The compared likelihood usingthe word spotting for every recognizing target vocabulary is supplied tothe recognizing target vocabulary correcting/normalizing unit 309together with the length of continuous time obtained by the spotting.

The environment adaptive noise model comparing unit 305 combines onlythe standard pattern which is previously selected with being adapted tothe noise environment in the environment adaptive-unit selecting unit308 from the recognizing-unit standard pattern stored in therecognizing-unit standard pattern storing unit 205, performs the wordspotting by using the halfway processing for comparing the optimalphoneme series transmitted from the optimal phoneme series comparingunit 304, and calculates the likelihood between the combined spottedresult and the time series of the characteristic vectors in thecharacteristic amount extracting unit 102. The likelihood as thecombining result having the obtained maximum likelihood and the lengthof continuous time of the environment adaptive noise model obtained bythe spotting are supplied to the environment noise likelihoodcorrecting/normalizing unit 311.

In step 401, the registered vocabulary likelihood correcting/normalizingunit 309 calculates a likelihood of the registered vocabulary aftercorrection/normalization Pi (=(Sopt−Si)/Ti) by using a likelihood of theregistered vocabulary likelihood Si for each recognizing targetvocabulary, a length of continuous time Ti, and a best likelihood Soptfrom the optimal phoneme series comparing unit 304.

In step 402, the recognizing result determining unit 310 compares thelikelihoods of the corrected/normalized recognizing target vocabularies(likelihoods of the registered vocabularies), and determines therecognizing target vocabulary having the corrected/normalized likelihoodhaving the minimum value.

In step 403, the rejection determining unit 312 using the comparedlikelihood compares the likelihood of the registered vocabulary aftercorrecting/normalizing the recognizing target vocabulary selected by therecognizing result determining unit 310 with the predeterminedthreshold, and determines whether or not the input speech is the noise.That is, if the likelihood after correction/normalization Pi is largerthan the predetermined threshold, it is determined that the input speechis the noise and the rejection result is outputted (step 407). On thecontrary, if the likelihood after correction/normalization Pi is smallerthan the predetermined threshold, it is determined that the input speechis not the noise and the determining result is supplied to the rejectiondetermining unit 313 using the environment adaptive noise model.

In step 404, similarly to the registered vocabulary likelihoodcorrecting/normalizing unit 309, the environment noise likelihoodcorrecting/normalizing unit 311 calculates a likelihood of theenvironment noise after correction/normalization, Pns=(Sopt−Sns)/Tns, byusing the compared likelihood of the environment adaptive noise model(likelihood of the environment noise) Sns, the length of continuous timeTns, and the optimal likelihood Sopt transmitted from the optimalphoneme series comparing unit 304.

In step 405, with regard to the input speech which is not determined asthe noise by the rejection determining unit 312 using the comparedlikelihood, the rejection determining unit 313 using the environmentadaptive noise model compares the likelihood of the registeredvocabulary after correction/normalization Pi of the recognizing targetvocabulary selected by the recognizing result determining unit 310 withthe likelihood of the environment noise after correction/normalizationPns. If Pi>Pns, the environment adaptive noise model is closer to thecompared likelihood of the optimal phoneme series and therefore therejection determining unit 313 determines that the input speech is thenoise (step 407). On the contrary, if Pi≦Pns, the rejection determiningunit 313 determines that the input speech is not the noise but thespeech of the recognizing target vocabulary selected by the recognizingresult determining unit 310, and outputs the recognizing targetvocabulary selected in step 406 as the result of recognizing the speech.

Next, a description is given regarding the operation of the rejectiondetermining unit 313 using the environment adaptive noise model when therecognizing target vocabulary is inputted and when the environment noiseis inputted, with reference to FIGS. 8A and 8B.

FIG. 8A shows a case of inputting “KOBE (k/ou/b/e)” as the recognizingtarget vocabulary. The recognizing target vocabulary is inputted andthen the rejection determining unit 313 using the environment adaptivenoise model selects the recognizing target vocabulary “KOBE (k/ou/b/e)”with the minimum likelihood of the registered vocabulary aftercorrection/normalization from the recognizing target vocabularies. Now,reference symbol Pw denotes the corrected/normalized likelihood.Incidentally, the recognizing-unit standard pattern uses the phonemeexpressed by a phonetic symbol.

In the case of comparing using the environment adaptive noise model, therecognizing units selected adaptively to the environment are combinedand a combination having the minimum likelihood of the environment noiseafter correction/normalization is determined. For example, selectedphonemes are “u”, “s”, and “f”, the combining result having the minimumlikelihood of the environment noise after correction/normalization is“f/u/s/s/u/s”, and reference symbol Pns herein denotes thecorrected/normalized likelihood in this case.

If the input is “KOBE (k/ou/b/e)”, the corrected/normalized likelihoodPw of the recognizing target vocabulary “KOBE (k/ou/b/e)” is smallerthan the corrected/normalized likelihood Pns of the environment adaptivenoise model “f/u/s/s/u/s” and therefore the recognizing result “KOBE(k/ou/b/e)” is outputted.

Referring to FIG. 8B, when the noise is inputted, similarly to theabove-mentioned example, the vocabulary “KOBE (k/ou/b/e)” having theminimum likelihood of the registered vocabulary aftercorrection/normalization is selected from the recognizing targetvocabularies and then it is larger than the likelihood of theenvironment noise after correction/normalization of the combination ofthe phoneme models “f”, “s”, and “u” which are adaptively selected forthe environment noise. The result is rejected.

Next, a description is given regarding the operation for selecting theenvironment adaptive noise model based on the result of determining therejection.

If the rejection determining unit 312 using the compared likelihood orthe rejection determining unit 313 using the environment adaptive noisemodel determines that the input speech is the noise, the result ofcombining the recognizing-unit standard patterns obtained by the optimalphoneme series comparing unit 304 matches to the recognizing-unitstandard pattern having the maximum likelihood of the input environmentnoise. That is, the previously-learned recognizing-unit standard patternis selected with acoustic characteristics which are most pseudo to thoseof the input noise environment from the recognizing-unit standardpattern storing unit 205.

The noise model adaptive to the noise environment under which the speechrecognizing apparatus is used is formed by selecting again therecognizing-unit standard pattern in the environment recognizing-unitselecting unit 308 by using the result of the optimal phoneme seriescomparing unit 304.

FIG. 9 is an explanatory diagram of examples of the adaptation to theenvironment when it is determined that the input speech is the noise.

When it is determined that the input speech is the noise, theenvironment adaptive recognizing-unit selecting unit 308 updates theappearance frequency under the noise environment of the recognizing-unitstandard pattern by using the statistics and the history of therecognizing-unit standard pattern used by the optimal phoneme seriescomparing unit 304, and uses the standard pattern having thehigh-ordered appearance frequency as a next noise model. As mentionedabove, when it is determined that the input speech is the noise, thestandard pattern matching to the noise is selected, thereby alwaysadapting the noise model to the environmental noise.

Referring to FIG. 9, the examples using three patterns “s”, “f”, and “a”having the high-ordered appearance frequencies are shown as the initialrecognizing-unit standard patterns. Further, as shown in FIG. 9, theappearance ratio of the result of determining the rejection is changedand a result of the noise determination 1 indicates the use of therecognizing-unit standard patterns “s”, “f”, and “dz”. Furthermore, aresult of the noise determination 2 indicates the use of therecognizing-unit standard patterns “If”, “s”, and “u”.

The environment adaptive recognizing-unit selecting unit 308 may set therecognizing-unit standard pattern obtained from the optimal phonemeseries comparing unit 304 as the next noise model without using thestatistics and the history of the recognizing-unit standard pattern usedby the optimal phoneme series comparing unit 304.

The third embodiment uses the rejection determination using thelikelihood of the registered vocabulary after correction/normalizationand the rejection determination using the likelihood of the environmentnoise after correction/normalization. FIG. 10 is an explanatory diagramof advantages obtained by the two rejection determinations.

Referring to FIG. 10, the ordinate shows the likelihood as the comparedresult and three statuses (a), (b), and (c) as the real environmentsindicate the likelihood using the optimal phoneme series comparing (bestlikelihood), the maximum likelihood of the recognizing target vocabulary(likelihood of the registered vocabulary), and the likelihood of theenvironment adaptive noise model (likelihood of the environment noise),respectively. As shown in FIG. 10, the length of continuous time usingthe word spotting of the recognizing target vocabulary is equal to thelength of continuous time using the word spotting of the environmentadaptive noise model for the purpose of a belief description. In thiscase, the rejection determination using the environment adaptive noisemodel may be performed by the corrected likelihood of the registeredvocabulary and the corrected likelihood of the environment noise.

Referring to the status (a) in FIG. 10, when the speech is inputted, theoptimal likelihood as the result of comparing the optimal phoneme serieshaving the highest freedom to the combination of the standard patternbecomes maximum. When the input speech is included in the recognizingtarget vocabularies, the likelihood of the registered vocabulary of therecognizing target vocabulary might substantially be equal to theoptimal likelihood. On the contrary, the environment adaptive noisemodel has only the standard pattern matching to the noise and thereforethe likelihood of the environmental noise becomes small when the rightvocabulary is inputted.

Consequently, the likelihood of the registered vocabulary aftercorrection/normalization is smaller than the likelihood of theenvironmental noise after correction/normalization. The input speech isnot rejected in the case of the rejection determination using theenvironment adaptive noise model, and the rejection determinationdepends on that using the likelihood of the registered vocabulary.

Next, a description is given regarding the case in which the noise isinputted and then the recognizing-unit standard pattern has a patternobtained by acoustically modeling the environmental noise.

In this case, the recognizing-unit standard pattern has a model matchingto the environmental noise. Referring to the status (b) in FIG. 10,similarly to the case in which the speech is inputted, the optimallikelihood of the result of comparing the optimal phoneme series mighthave a large value. On the other hand, the input of the recognizingtarget vocabulary is the environment noise and therefore the recognizingtarget vocabulary has a smaller value as compared with the case in whichthe recognizing target vocabulary is inputted. Consequently, thelikelihood of the registered vocabulary after correction/normalizationbecomes large and the input speech is determined as the rejection byusing the compared likelihood.

When the input speech is not determined as the rejection by using thecompared likelihood, the likelihood of the environmental noise using theenvironment adaptive noise model might have substantially the same valueas that of the optimal likelihood. Therefore, the input speech isrejected by the rejection determination using the environment adaptivenoise model.

Next, a description is given regarding the case in which the noise isinputted and then the recognizing-unit standard pattern has no patternobtained by acoustically modeling the environmental noise.

In this case, the recognizing-unit standard pattern has no modelmatching to the noise environment. Referring to the status (c) in FIG.10, both the optimal likelihood and the likelihood of the registeredvocabulary of the recognizing target vocabulary are small. Thus, thelikelihood of the registered vocabulary after correction/normalizationis also small and the rejection determination of the input speech cannotbe performed by the compared likelihood.

However, when using the result of compared operation based on theenvironment noise adaptive model, if it is determined that the input isthe noise, the standard pattern frequently appearing under the currentnoise environment is then selected from the recognizing-unit standardpattern. The likelihood of the environmental noise is obtained by usingthe selected standard pattern so that the value close to that of theoptimal phoneme is obtained. In this case, it is probably determinedthat the input is the noise because of the rejection determination bythe environment adaptive noise model.

As mentioned above, according to the third embodiment, the sameadvantages as those according to the first and second embodiments areobtained. Further, both the rejection determination using theenvironment adaptive noise model and the rejection determination usingthe likelihood of the registered vocabulary of the recognizing targetvocabulary are simultaneously used. The rejection determination of inputof the environment noise can be performed with high accuracy.

Having described the preferred embodiments of the invention referring tothe accompanying drawings, it should be understood that the presentinvention is not limited to those precise embodiments and variouschanges and modifications thereof could be made by one skilled in theart without departing from the spirit of scope of the invention asdefined in the appended claims.

1. A computer-readable medium storing a speech recognizing computerprogram, the computer program determining a computer to execute: speechsection detecting processing for detecting a speech section from aninput signal; characteristic amount extracting processing for analyzingan input speech, which is the input signal in the speech section, andextracting the time series of the amount of characteristics representingcharacteristics of the input speech; a recognizing target vocabularycomparing processing of comparing the time series of the amount ofcharacteristics with respective recognizing target vocabularies readfrom a recognizing target vocabulary storing unit to store predeterminedrecognizing target vocabularies one by one to obtain a likelihood thatrespective recognizing target vocabularies coincide with the time seriesof the amount of characteristics; an environment adaptive noise modelcomparing processing of comparing the time series of the amount ofcharacteristics with one recognizing standard pattern or with two ormore combined recognizing standard patterns one by one to obtain alikelihood that respective environment adaptive noise models coincidewith the time series of the amount of characteristics; rejectiondetermining processing for determining whether or not the input signalis a noise by comparing the likelihood obtained by recognizing targetvocabulary comparing processing with the likelihood obtained byenvironment adaptive noise model comparing processing; and noise modeladapting processing for, when it is determined that the input signal isthe noise, ordering the recognizing standard patterns and selecting apredetermined number of higher-ordered recognizing standard patterns. 2.The computer-readable medium storing a speech recognizing computerprogram according to claim 1, wherein the environment adaptive noisemodel comparing processing combines the patterns selected in the noisemodel adapting processing and determines a likelihood of environmentnoise for another speech input.
 3. The computer-readable medium storinga speech recognizing computer program according to claim 1, wherein thenoise model adapting processing calculates a first likelihood bycomparing the time series of the amount of characteristics withrecognizing standard patterns and orders the recognizing standardpatterns in accordance with a size of the first likelihood.
 4. Acomputer-readable medium storing a speech recognizing computer program,the computer program determining a computer to execute: speech sectiondetecting processing for detecting a speech section from an inputsignal; characteristic amount extracting processing for analyzing aninput speech, which is the input signal in the speech section, andextracting the time series of the amount of characteristics representingthe characteristics of the input speech; a recognizing target vocabularycomparing processing of comparing the time series of the amount ofcharacteristics with respective recognizing target vocabularies readfrom a recognizing target vocabulary storing unit to store predeterminedrecognizing target vocabularies one by one to obtain a likelihood thatrespective recognizing target vocabularies coincide with the time seriesof the amount of characteristics; an environment adaptiverecognizing-unit selecting processing of selecting at least onerecognizing-unit standard patterns adaptive to an environmental noisefrom a recognizing-unit standard pattern storing unit to storerecognizing-unit standard patterns; an environment adaptive noise modelcomparing processing for comparing the time series of the amount ofcharacteristics with one recognizing-unit standard pattern or with twoor more combined recognizing-unit standard patterns, selected by theenvironment adaptive recognizing-unit selecting step one by one, toobtain a likelihood that the respective environment adaptive noisemodels coincide with the time series of characteristics; rejectiondetermining processing for determining whether or not the input signalis a noise based on the likelihood obtained by recognizing targetvocabulary comparing processing and the likelihood obtained byenvironment adaptive noise model comparing processing; and processingfor selecting again the recognizing-unit standard pattern stored in therecognizing-unit standard pattern storing unit so as to adapt to theinput signal when it is determined that the input signal is the noise byordering the recognizing-unit standard patterns and selecting apredetermined number of higher-ordered recognizing-unit standardpatterns, wherein the recognizing-unit standard pattern is a phonememodel.
 5. The computer-readable medium storing a speech recognizingcomputer program according to claim 4, wherein the environment adaptivenoise model comparing processing combines the patterns selected in theprocessing for selecting again and determines a likelihood ofenvironment noise for another speech input.
 6. The computer-readablemedium storing a speech recognizing computer program according to claim2, wherein the processing for selecting again calculates a firstlikelihood by comparing the time series of the amount of characteristicswith recognizing standard patterns and orders the recognizing standardpatterns in accordance with a size of the first likelihood.
 7. Acomputer-readable medium storing a speech recognizing computer program,the computer program determining a computer to execute: speech sectiondetecting processing for detecting a speech section from an inputsignal; characteristic amount extracting processing for analyzing aninput speech, which is the input signal in the speech section, andextracting the time series of the amount of characteristics representingthe characteristics of the input speech; a recognizing target vocabularycomparing processing of comparing the time series of the amount ofcharacteristics with respective recognizing target vocabularies readfrom a recognizing target vocabulary storing unit to store predeterminedrecognizing target vocabularies one by one to obtain a likelihood thatrespective recognizing target vocabularies coincide with the time seriesof the amount of characteristics; an environment adaptiverecognizing-unit selecting processing of selecting at least onerecognizing-unit standard patterns adaptive to an environmental noisefrom a recognizing-unit standard pattern storing unit to storerecognizing-unit standard patterns; an environment adaptive noise modelcomparing processing for comparing the time series of the amount ofcharacteristics with one recognizing-unit standard pattern or with twoor more combined recognizing-unit standard patterns, selected by theenvironment adaptive recognizing-unit selecting step one by one, toobtain a likelihood that the respective environment adaptive noisemodels coincide with the time series of characteristics; rejectiondetermining processing for determining whether or not the input signalis a noise based on the likelihood obtained by recognizing targetvocabulary comparing processing and the likelihood obtained byenvironment adaptive noise model comparing processing; and processingfor selecting again the recognizing-unit standard pattern stored in therecognizing-unit standard pattern storing unit so as to adapt to theinput signal when it is determined that the input signal is the noiseincluding ordering the recognizing-unit standard patterns and selectinga predetermined number of higher-ordered recognizing-unit standardpatterns, wherein the rejection determining processing determineswhether or not the input signal is the noise by comparing the likelihoodobtained by the recognizing target vocabulary comparing processing withthe likelihood obtained by the environment adaptive noise modelcomparing processing.
 8. The computer-readable medium storing a speechrecognizing computer program according to claim 7, wherein theenvironment adaptive noise model comparing processing combines thepatterns selected in the processing for selecting again and determines alikelihood of environment noise for another speech input.
 9. Thecomputer-readable medium storing a speech recognizing computer programaccording to claim 7, wherein the processing for selecting againcalculates a first likelihood by comparing the time series of the amountof characteristics with recognizing standard patterns and orders therecognizing standard patterns in accordance with a size of the firstlikelihood.
 10. A computer-readable medium storing a speech recognizingcomputer program, the computer program determining a computer toexecute: speech section detecting processing for detecting a speechsection from an input signal; characteristic amount extractingprocessing for analyzing an input speech, which is the input signal inthe speech section, and extracting the time series of the amount ofcharacteristics representing the characteristics of the input speech; arecognizing target vocabulary comparing processing of comparing the timeseries of the amount of characteristics with respective recognizingtarget vocabularies read from a recognizing target vocabulary storingunit to store predetermined recognizing target vocabularies one by oneto obtain a likelihood that respective recognizing target vocabulariescoincide with the time series of the amount of characteristics; anenvironment adaptive recognizing-unit selecting processing of selectingat least one recognizing-unit standard patterns adaptive to anenvironmental noise from a recognizing-unit standard pattern storingunit to store recognizing-unit standard patterns; an environmentadaptive noise model comparing processing for comparing the time seriesof the amount of characteristics with one recognizing-unit standardpattern or with two or more combined recognizing-unit standard patterns,selected by the environment adaptive recognizing-unit selecting step oneby one, to obtain a likelihood that the respective environment adaptivenoise models coincide with the time series of characteristics; rejectiondetermining processing for determining whether or not the input signalis a noise based on the likelihood obtained by recognizing targetvocabulary comparing processing and the likelihood obtained byenvironment adaptive noise model comparing processing; and processingfor selecting again the recognizing-unit standard pattern stored in therecognizing-unit standard pattern storing unit so as to adapt to theinput signal when it is determined that the input signal is the noiseincluding ordering the recognizing-unit standard patterns and selectinga predetermined number of higher-ordered recognizing-unit standardpatterns, wherein the rejection determining processing comprises: afirst determining processing to determine the rejection by using thelikelihood obtained by the recognizing target vocabulary comparingprocessing; and a second determining processing to determine therejection by using the likelihood obtained by the environment adaptivenoise model comparing processing.
 11. The computer-readable mediumstoring a speech recognizing computer program according to claim 10,wherein the first determining processing determines a rejection bycomparing the likelihood obtained by the recognizing target vocabularycomparing processing with a predetermined threshold, and the seconddetermining processing determines a rejection of the input signal whichis determined as the speech by the first determining processing by usingthe likelihood obtained by the environment adaptive noise modelcomparing processing.
 12. The computer-readable medium storing a speechrecognizing computer program according to claim 10, wherein theenvironment adaptive noise model comparing processing combines thepatterns selected in the processing for selecting again and determines alikelihood of environment noise for another speech input.
 13. Thecomputer-readable medium storing a speech recognizing computer programaccording to claim 10, wherein the processing for selecting againcalculates a first likelihood by comparing the time series of the amountof characteristics with recognizing standard patterns and orders therecognizing standard patterns in accordance with a size of the firstlikelihood.
 14. A speech recognizing method comprising: a speech sectiondetecting step of detecting a speech section from an input signal; acharacteristic amount extracting step of analyzing an input speech,which is the input signal in the speech section, and extracting the timeseries of the amount of characteristics representing characteristics ofthe input speech; a recognizing target vocabulary comparing step ofcomparing the time series of the amount of characteristics withrespective recognizing target vocabularies read from a recognizingtarget vocabulary storing unit to store predetermined recognizing targetvocabularies one by one to obtain a likelihood that respectiverecognizing target vocabularies coincide with the time series of theamount of characteristics; an environment adaptive noise model comparingstep of comparing the time series of the amount of characteristics withrecognizing standard pattern or with two or more combined recognizingstandard patterns one by one to obtain a likelihood that respectiveenvironment adaptive noise models coincide with the time series of theamount of characteristics; a rejection determining step of determiningwhether or not the input signal is a noise by comparing the likelihoodobtained by the recognizing target vocabulary comparing step with thelikelihood obtained by environment adaptive noise model comparing step;and a noise model adapting processing step, when it is determined thatthe input signal is the noise, of ordering the recognizing standardpatterns and selecting a predetermined number of higher-orderedrecognizing standard patterns.
 15. The speech recognizing methodaccording to claim 14, wherein the environment adaptive noise modelcomparing step combines the patterns selected in the noise modeladapting processing and determines a likelihood of environment noise foranother speech input.
 16. The speech recognizing method according toclaim 14, wherein the noise model adapting step calculates a firstlikelihood by comparing the time series of the amount of characteristicswith recognizing standard patterns and orders the recognizing standardpatterns in accordance with a size of the first likelihood.
 17. A speechrecognizing method comprising: a speech section detecting step ofdetecting a speech section from an input signal; a characteristic amountextracting step of analyzing an input speech, which is the input signalin the speech section, and extracting the time series of the amount ofcharacteristics of the input speech; a recognizing target vocabularycomparing step of comparing the time series of the amount ofcharacteristics with respective recognizing target vocabularies readfrom a recognizing target vocabulary storing unit to store predeterminedrecognizing target vocabularies one by one to obtain a likelihood thatrespective recognizing target vocabularies coincide with the time seriesof the amount of characteristics; an environment adaptiverecognizing-unit selecting step of selecting at least onerecognizing-unit standard patterns adaptive to an environmental noisefrom a recognizing-unit standard pattern storing unit to storerecognizing-unit standard patterns; an environment adaptive noise modelcomparing step for comparing the time series of the amount ofcharacteristics with one recognizing-unit standard pattern or with twoor more combined recognizing-unit standard patterns, selected by theenvironment adaptive recognizing-unit selecting step one by one, toobtain a likelihood that the respective environment adaptive noisemodels coincide with the time series of characteristics; a rejectiondetermining step of determining whether or not the input signal is anoise based on the likelihood obtained by the environment adaptiverecognizing-unit selecting step and the likelihood obtained by theenvironment adaptive noise model comparing step; and a step of selectingagain the recognizing-unit standard pattern stored in therecognizing-unit standard pattern storing unit so as to adapt to theinput signal when it is determined that the input signal is the noiseincluding ordering the recognizing-unit standard patterns and selectinga predetermined number of higher-ordered recognizing-unit standardpatterns, wherein the recognizing-unit standard pattern is a phonememodel.
 18. The speech recognizing method according to claim 17, whereinthe environment adaptive noise model comparing step combines thepatterns selected in the step of selecting again and determines alikelihood of environment noise for another speech input.
 19. The speechrecognizing method according to claim 17, wherein the step of selectingagain calculates a first likelihood by comparing the time series of theamount of characteristics with recognizing standard patterns and ordersthe recognizing standard patterns in accordance with a size of the firstlikelihood.
 20. A speech recognizing method comprising: a speech sectiondetecting step of detecting a speech section from an input signal; acharacteristic amount extracting step of analyzing an input speech,which is the input signal in the speech section, and extracting the timeseries of the amount of characteristics of the input speech; arecognizing target vocabulary comparing step of comparing the timeseries of the amount of characteristics with respective recognizingtarget vocabularies read from a recognizing target vocabulary storingunit to store predetermined recognizing target vocabularies one by oneto obtain a likelihood that respective recognizing target vocabulariescoincide with the time series of the amount of characteristics; anenvironment adaptive recognizing-unit selecting step of selecting atleast one recognizing-unit standard patterns adaptive to anenvironmental noise from a recognizing-unit standard pattern storingunit to store recognizing-unit standard patterns; an environmentadaptive noise model comparing step for comparing the time series of theamount of characteristics with one recognizing-unit standard pattern orwith two or more combined recognizing-unit standard patterns, selectedby the environment adaptive recognizing-unit selecting step one by one,to obtain a likelihood that the respective environment adaptive noisemodels coincide with the time series of characteristics; a rejectiondetermining step of determining whether or not the input signal is anoise based on the likelihood obtained by the environment adaptiverecognizing-unit selecting step and the likelihood obtained by theenvironment adaptive noise model comparing step; and a step of selectingagain the recognizing-unit standard pattern stored in therecognizing-unit standard pattern storing unit so as to adapt to theinput signal when it is determined that the input signal is the noiseincluding ordering the recognizing-unit standard patterns and selectinga predetermined number of higher-ordered recognizing-unit standardpatterns, wherein the rejection determining step determines whether ornot the input signal is the noise by comparing the likelihood obtainedby the recognizing target vocabulary comparing step with the likelihoodobtained by the environment adaptive noise model companng step.
 21. Thespeech recognizing method according to claim 20, wherein the environmentadaptive noise model comparing step combines the patterns selected inthe step of selecting again and determines a likelihood of environmentnoise for another speech input.
 22. The speech recognizing methodaccording to claim 20, wherein the step of selecting again calculates afirst likelihood by comparing the time series of the amount ofcharacteristics with recognizing standard patterns and orders therecognizing standard patterns in accordance with a size of the firstlikelihood.
 23. A speech recognizing method comprising: a speech sectiondetecting step of detecting a speech section from an input signal; acharacteristic amount extracting step of analyzing an input speech,which is the input signal in the speech section, and extracting the timeseries of the amount of characteristics of the input speech; arecognizing target vocabulary comparing step of comparing the timeseries of the amount of characteristics with respective recognizingtarget vocabularies read from a recognizing target vocabulary storingunit to store predetermined recognizing target vocabularies one by oneto obtain a likelihood that respective recognizing target vocabulariescoincide with the time series of the amount of characteristics; anenvironment adaptive recognizing-unit selecting step of selecting atleast one recognizing-unit standard patterns adaptive to anenvironmental noise from a recognizing-unit standard pattern storingunit to store recognizing-unit standard patterns; an environmentadaptive noise model comparing step for comparing the time series of theamount of characteristics with one recognizing-unit standard pattern orwith two or more combined recognizing-unit standard patterns, selectedby the environment adaptive recognizing-unit selecting step one by one,to obtain a likelihood that the respective environment adaptive noisemodels coincide with the time series of characteristics; a rejectiondetermining step of determining whether or not the input signal is anoise based on the likelihood obtained by the environment adaptiverecognizing-unit selecting step and the likelihood obtained by theenvironment adaptive noise model comparing step; and a step of selectingagain the recognizing-unit standard pattern stored in therecognizing-unit standard pattern storing unit so as to adapt to theinput signal when it is determined that the input signal is the noiseincluding ordering the recognizing-unit standard patterns and selectinga predetermined number of higher-ordered recognizing-unit standardpatterns, wherein the rejection determining step comprises: a firstdetermining step for determining the rejection by using the likelihoodobtained by the recognizing target vocabulary comparing step; and asecond determining step for determining the rejection by using thelikelihood obtained by the environment adaptive noise model comparingstep.
 24. The speech recognizing method according to claim 23, whereinthe first determining step determines a rejection by comparing thelikelihood obtained by the recognizing target vocabulary comparing stepwith a predetermined threshold, and the second determining stepdetermines a rejection of the input signal which is determined as thespeech by the first determining step by using the likelihood obtained bythe environment adaptive noise model comparing step.
 25. The speechrecognizing method according to claim 23, wherein the environmentadaptive noise model comparing step combines the patterns selected inthe processing for selecting again step and determines a likelihood ofenvironment noise for another speech input.
 26. The speech recognizingmethod according to claim 23, wherein the step of selecting againcalculates a first likelihood by comparing the time series of the amountof characteristics with recognizing standard patterns and orders therecognizing standard patterns in accordance with a size of the firstlikelihood.
 27. A speech recognizing apparatus, comprising: a speechsection detecting unit to detect a speech section from an input signal;characteristic amount extracting unit top analyzing an input speech,which is the input signal in the speech section, and extract the timeseries of the amount of characteristics representing characteristics ofthe input speech; a recognizing target vocabulary comparing unit tocompare the time series of the amount of characteristics with respectiverecognizing target vocabularies read from a recognizing targetvocabulary storing unit to store predetermined recognizing targetvocabularies one by one to obtain a likelihood that respectiverecognizing target vocabularies coincide with the time series of theamount of characteristics; an environment adaptive noise model comparingunit to compare the time series of the amount of characteristics withone recognizing standard pattern or with two or more combinedrecognizing standard patterns one by one to obtain a likelihood thatrespective environment adaptive noise models coincide with the timeseries of the amount of characteristics; rejection determining unit todetermine whether or not the input signal is a noise by comparing thelikelihood obtained by recognizing target vocabulary comparingprocessing with the likelihood obtained by environment adaptive noisemodel comparing processing; and noise model adapting unit to, when it isdetermined that the input signal is the noise, order the recognizingstandard patterns and selecting a predetermined number of higher-orderedrecognizing standard patterns.